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ABSTRACT 

Computer-based instructional programs in the 
affective and communication skills areas incorporating some of the 
results of an earlier research) and development' project were 
implemented and evaluated int a/ R^^cruit Training Command. The programs 
involved the use of a stand- alone \computer-based system* for 
evaluating and training, recrui't company commanders and for obtaining 
information needed for managing Recruit Training Command operations 
in general. In acco|^plishing these functions, the computer controlled 
the operation of a videotape player and a card reader in addition to 
some more traditional components of a computer-based training system. 
A new computer language was developed especially for facilitating the 
transfer of some programs previously prepared in PLATO IV coding to a 
form compatible with the curre'ht computer system. Preliminary efforts 
to evaluate the feasibility ai|id .desir ability of these programs 
inxiica^ied that the system can operate as intended in the operational 
setting and that its acceptance by Recruit Training, Command personnel 
is generally favorable. The results also indic'a ted that the syst^r/ 
wo.uld entail relatively small expenditures to acguire, operate, and 
maintain. (Author/CMV) \ 



* Reproductions supplied by EDRS are tfi^e best th^t can be made * 

* from the original document. * 



o 



NATIONAL INITlfif^SJ 
■ OUCATION 



^ TECHNICAL REPORT: NAVTRAEQUIPCEN IH -(300 



DEVELOPMENT AND IMPLEMENTATION OF A COMPTJTERIXED 
EVALUATION Af© TRAINING SYSTEM (GETS) AT A 
^ RECRUIT TRAINING COMMAND 



Human Factors Laboratory 
Naval Training Equipment Center 
Orlando, Florida 32813 

and 

APPLI-mTION, INC. 
930 Woodcock Road, Suite 111 
Orlando, Florida 32813 "1 



FINAL REPORT SEPTEMBER 1976 - DECEMBER 1977 

_ / 

March 1978 / / 

Prepared for: / ^ 

■■ -^^ ■. 

Naval Personnel Research ai.d Developments Cepter 
Code 9304 ^ 
^San Diego, California 92152 

and , . ^ 

Manpower Research and Development Program 
Office of Naval Research 
Arlington, Virginia 22217 



^ r 



♦1^ 



UNCLASSIFIED 



SECURtTV CU^$SIF<CAT10N OF THIS PAGE (Wh»n Dmtm En(mfd) 



REPORT DOCUMENTATION PAGE 



•READ INSTRUCTIONS 
BEFORE COMPLETING FORM 



). REPORT NUMeCR 

^AVTRAEQUIPCEN IH-3QQ 



)2. GOVT ACCESSION NO. 



3. RECIPIENT'S CATALOQ NUMBER 



IMPLEMENTATION OF A COMPUTEfMZED 
EVALUATION AND TRAINING SYSTEM ('CETS) AT A RfCRUlT 
TRAINING COMMAND 



_S_. TYPE OF REPORT ft PERIOO COVERED 

■inal Report for period 
September 1976 - December 1977 



AUTMORCj^ 

Arthur S. Blaiwes, Dennis R. Weller, 
George Romot 



«. PERFORMING ORG. REPORT MUM8ER 

NAVTRAEQUIPCEN Ih-30G 



9 PERFORMING ORGANIZATION NAME ANO ADDRESS 

Human Factors Laboratory (N-71) 
^aval Training Equipment Center 
Orlando, FL 32813 



T CONTRACi 0#? GRANT NUMbERr«J 



10. PROGRAM EL EMEN T. PROJECT. TASK 
AREA ft WORK UN(T NUMBERS 



3755 



II. ..CONTROI.LTNG OFFICE KAME ANO ADDRESS 

^avy Personnel Rese'^rch and Development Center 
Codft. 9304 

San Diec^o, CA 92152 AND 



12- REPORT DATE 

.March 1978 



13. NUMBER OF PAGES 

46 



Manpower Research ^nd Development Program 
Office of Naval Research 
Arlington, VA 



IS. SECURI TY CLASS. Co' rAJ* '«porr; 

UNCLASSIFIED 



15*. DECL ASSIFI CATION/ DOWNGRADING 
SCHEDULE 



16. DISTRIBUTION ST AT dMEN T fof thi ^ Report) 



u 



pproved for public release; distrit)ution unlimited. 



17. OISTribl'TION statement Cot thm t-imtrmct tiimnd In aittck 30. II Mtlatmnt tnm Rtport) 



8- SUPPL EfyiEN TARY MOTES 



19- K 



EY WORDS (Continue on rmwmrwm 9idm If nmcmmmmry mnd Idmntity by block humbmr) 



Computer-Assisted Instruction 
iHuman Relations Training 
iLeadership Training 
Company Commander Training 
Performance Evaluation 



Management Aid 
Video-taped Instruction 
Instructor Training 
Computer Data Managememt 



^ *flL?7/'^^'^ CConttnum an r*wm midm li nmc^mmmrr Idmntltr by btock ntimbme) * 

This report documents a one-year effort in which some of the results of 
an earlier research and development project were prepared for implementation 
at a Recruit Training Corrmand. This project jncerned computer-based in- 
struction for recniit company cormanders in the affective and communication 
Skills areas. In an ongoing continuation of this effort, the more complete 
preparation, implementation, and evaluation of these capabilities are. under--, 
way • 

• { (Cont'd) 



DO 



. 1473 



EDITION OF y MOV S3 IS OBSOLETE 

S/W 0 102-0 14- 660 1 f 



II 



ERIC 



UNCLASSfFlED 

SCCURITV CLASSIFICATION or YMIS PAGE (Whmn Dmtm 



mntmrmd) 



UNCLASSIFIED 



.il^irr CLASSIFICATION Of THIS PACEfWh.rt Dalm Enfrmd) 



The programs involved the use of a stand-alone computer-based system for 
evaluating and training company commanders and for obtaining information 
needed for managing Recruit Training Conmand operations in general. In ac- 
complishing these functions, the computer controlled the operation of a .video 
tape player and a card reader in addition to some more traditional components 
iLl 9°!"P"t«r-based training system. A new computer language was developed ■ 
fn^ml?n ^v^'^"'/^'"'!'*^*!"^ transfer of some programs previously prepared 
in PLA.O IV coding to a form compatible with the current computer systan^ 

Preliminary efforts to evaluate-the feasibility and desirability of these 
programs indicated that the system can operate as intended .in the operational 
setting and that its acceptance by Recruit Training Comnand personnpl is 
generally favorable. The results also indicated that the system would entail 
relatively small expenditures to acquire, operate, and maintain. 
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SUMMARY AND CONCLUSIONS 

This report documents a one-year effort in which some of the results of 
an earlier research and development project were prepared for implementation 
at a Recruit Training Command. This project concerned computer-based in- 
struction for recruit company commanders in the affective and comrnunication 
skills areas. In an ongoing continuation of this effort, the more complete 
preparation, implementation, and evaluation of these capabilities are under- 
way. , . < - 

The programs involved the use of a stand-alone computer-based system for 
evaluating and training company conmanders and for obtaining informativin 
needed for managing Recruit Training Command operations in general. In ac- 
complishing these functions, the computer controlled the operation of a video 
tape player and a card reader in addition to some more traditional components 
of a computer-based training systpf^i. A new computer language was developed 
especially for facilitating the transfer of some programs previously p'repared 
in PLATO IV coding to a form compatible with the current computer system. 

Preliminary efforts to evaluate the feasibility and desirability of these 
programs indicated that the system can o^ierate as intended in the operational 
setting and that its acceptance ^--Recru't Training Command, personnel is 
generally favorable. The resuTts al so indicated that the system would entail 
relatively small .expenditures to acquire, operate, and maintain; especially 
when one considers the higher costs and lower qual'ity to be expected if these 
training and management functions were performed by other means. The ultimate 
desirability of performing these functions by any means is a more complex 
issue, as it is for almost any of the operations of large organizations such 
as a Recruit Training Command.. The' critical ity of this issue, however, demands 
that greater attention be given to its' resolution. 

The current effort is considered only an introductory demonstration of the 
types of tasks that can be profitably assigned to a computer at Recruit 
Training Commands. The cost effectiveness of- the system would be expected to 
increase markedly as other applications are included along with the present 
one. This report suggests a variety of projects for future research and 
development that would appear to contribute to the cost-effectiveness cf • a 
system similar to the present one. 
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PREFACE 

This project was jointly' funded by the Navy Personnel Research and Develop- 
ment Center and the Office of Naval Research. (The Office of Naval Research 
supported the effort related, to the video tape portions of the training mate- 
rials.) "This report documents the development of a computerized evaluation 
and training system (CETS) for use at the Recruit Training Commands (RTCs); 
as well as the initial phases of implementing and evaluating this system. 
The original plan called for a brief (two-month) field evaluation of the sys- 
tem. This has been expanded to extend the evaluation period throughout FY 78. 
The evaluation will include assessments of the operation, acceptance, u.;Bage, 
and effects of the system at RTC, Orlando. Some of the implementation activ- 
ities will be conducted by RTC, Orlando with support and evaluation assistance 
provided by NAVTRAEQUIPCEN. 

Many people at RTC, Orlando were very helpful in this effort. Most no- 
tably, LCDR. William Sullivan, NCI Ginger Simpson, CTRCS Zetterholm, all the 
division officers who helped in the development and promotion of the system, 
all the company comnanders who participated in the video taping and the 
company commander students. 

The complex and significant tasks of computer systems programming were 
accomplished by Mr. Marty Smith. The innovative computer programming 
approaches for the viaeo tape developments were accomplished by Mr. Pat Smith. 
Mr. Fred Delmos assisted in the preparation of- video tape training materials 
and he and Mr. Pat Smith were responsible for day-to-day operation of the 
system. 
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SECTION I 



INTRODUCTION 

It is generally recognized that interpersonal conmuni cations and relation- 
ships are critically important to organizational operations. Still, relative- 
ly little assistance seems to be provided toward improving the performance of 
these" activities. In an effort to ameliorate this situation, the possibility 
that computer technology might be beneficially applied to this area has been 
investigated./ 

Thus, the NAVTRAEQUIPCEN has been engaged over the past five years in 
determining a number of alternative approaches to the use of* computers for 
improving interactions among people and in testing and evaluating several of 
these approaches in operational settings. The operational settings for these 
efforts have been Recruit Training Cormiands- (RTCs) , and the focus of the 
efforts within the RTCs has been primarily on training and evaluating inter- 
personal aspects in the role of the recruit company commander (CC). The 

earlier programs and evaluations are described in other reports. ^ *^»^*^*^ 

The current project was directed toward preparing the latest version of - 
these training programs, demonstrated in the first half of 1976, for adoption 
by theRTC, Orlando. This version of the training consisted of a collection 
of instructional approaches and materials that, after many iterations, were 
designed to meet the research and operational requirements and conditions that 
prevailed at that point in time. Thus, due to time and funding restrictions, 
many potentially viable components of instruction developed in previous 
phases of this project we»^ not seriously considered for inclusion. 

The current phase of this project continued the effort to comply with re- 
search and operational requirements. However, this phase represents the most 
concerted action to date on this project to prepare a training package for 
acceptance and adoption by the RTC as a standard component of their operation. 

The endeavor to meet RTC requirements involved updating, modifying, and 
deleting existing training programs and developing new training and evaluation 



TT Spencer, G. J. and Hausser, D. L.; Blaiwes, A. S. and Weller, D. R. Use 
of Computer-Assisted Instruction for Interpersonal Skill Training - A Pilot 
Study. 1975. Technical Report: NAVTRAEQUIPCEN 73-C-0133-1. 

2. Cohen, J. L. and Fishbein, M. Development and Researcn Utjl izing the 
PLATO IV System for Company Commander Behavioral Change Training. August 

1975. Technical Report: NAVTRAEQUIPCEN 73-C-Ol 29-1. 

3. Hausser, D. L., Blaiwes, A. S., Weller, D. R., and Spencer . G. J. J\pplica- 
tion of Computer-Assisted Instruction to Interpersonal Skill m ling. January 

1976. Technical Report:" NAVTRAEQUIPCEN 74-C-OlOO-l. 

4. C£hen, J. L. and Fishbein, M. A Field Test of the PLATO IV ystem for 
Company Commander Behavioral Change Training. July 1976. Technical Report: 
NAVTRAEQUIPCEN 74-C-T0095-1. 

5. Lukas, G., Blaiwes, A. S., Weller, D. R. Evaluation of Human Relations 
Training Programs. January 1977. Technical Report: NAVTRAEQUIPCEN 
75-C-0076-1. , ' - 
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programs. In addition, it involved the selection and procurement of an appro- 
priate new computer system which had capabilities similar to but wh\ch was 

more economical than the PLATO IV system^ used previously.' 

This report discusses the procedures and results rel a ted^Ho-^' s effort to 

update and extend the earlier versions of the training and to implement end 

evaluate the new computerized evaluation and training system (GETS) that re- 
sulted. 




6. Meller, David V. Using PLATO IV. CERL, University of Illinois, Urbana. 
October 1975. . 
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' " , SECTION II . V 

SYSTEM DEVELOPMENT 

X I. - 

It was jointly determined By NAVTRAEQUIPCE-N and RTC. Orlando that the 
computer-based 'training "system should Include two^ma-jor components: (a) 
Evaluation - a new evaluation program for assesyfit5' the background, perform- 
ance, and. perceptions of «CCs and recruits, and^he relationship of these 
variables to. the opera-tion^of the organization; and ,(b) Training - a training 
program, made up of both existing and new training" material s, which would pro- 
, vide both compu;:er,5tased instruction and recommendations to correct, by other 
meads <e.^g. , counsel ing}, weaknesses revealed by the evaluation progra-^. 

NAVTRAEQUIPCEW then acqu>tred.'a computer system capable of handling these 
,two components, with cost-effectiveness the primary consideration. Necessary 
software systems. -and evaluation and training materials were developed and 
implemented. /■ 

Pr'ocedures f9r designing and developing the GETS system are described in 
the 'fol 1 owing: 

EVAIfCh^I^N PR'CTGrAm . 

' - \ '-^'^ 

The evaluation program was originally intended to provide information on 
the .performance of CC^s and to suggest ranedial action where needed. However, 
. it soon "1S"r came apparent that many other uses could be made of the system, due 
. to the nature and amount of data being collected and the processing power of 
the -computer. There1?Qre, the evaluation program evolved into a general manage- 
ment; tool for RTGvin addition to its evaluation role for CCs. 

DATA COLLECTION. Data for the evaluation program were collected from a variety 
of sources, as seen in Table 1. All data were col^.ected near the time of 
graduation of each recruit training unit at RTC. The Recruit Survey, Division 
Officer (DO) Evaluation, and CC Survey were developed jointly by RTC and 
NAVTRAEQUIPCEN personnel. 

In the selection of items for these questionnaires, a wide range of rele- 
vant areas was considered. A list of tentative items was drawn from several 
' sources including the scientific literature on leadership and performance 
evaluation, the leadership and evaluation practices of the Navy (especially 
those- of RTC), and results from previous phases of the project. The item lists 
were organized into categories by sorting the items into homogeneous groups 
and then defining and titling each group, items were deleted and added, and 
groups were redefined to assure maximum coverage and clarity with minimum 
redundancy. In addition, DOs, division adjutants and CC school personnel 
assessed the items and categories for their appropriateness, which provided 
the bases for additional modifications. The list was divided into three survey 
forms according to who was best qualified, due to his position at RTC, to 
answer each question — recruits, DOs, or CCs. The three survey forms appear 
in Appendix A (category information has been added to these forms for purposes 
of this report). ^ ^ ■ 
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The purpose of the Recruit Survey was to measure the CC's behavior in the 
areas of Instruction and interpersonal activities, and to measure the moral r- 
and attitudes of recruits. 

The purpose of the Division Officer Evaluation was to measure the CC's 
performance on the job and the training unit's quality. 

The purpose of the CC Survey was to provide measures of the CC's opinions 
and itttitudes about various aspects of RTC and his job. 

i 

The" forms were all answered on ontical scanning computer cards, and input 
to the system for storage and data r,^ i i r nl ation through a card reader. 

TABLE 1. DATA COLLECTION FOR EVALUATION PROGRAM 
DATA \ SOURCE NO. OF ITEMS 

1. CC Behaviors • Recruit Survey (filled 36 

■ out by all recruits of 
a given CC) 

2. CC Performance Division Officer Evalua- 31 

tion (filled out by the 
Division Officer of a 
given CC) 

3. CC Perceptions and CC Survey (filled out by' 37 
Background -.^ the Company Cotrmander) 

4. Recruit Attitudes Recruit Survey ,1^ 
(morale) 



5. RTC System Data RTC Records ^16 

\ (includes T.U. back- 

ground and perform- 
> ance, and some CC ' - — 

background items) 

DATA PROCESSING ANIX DISPLAYS. The operation of the evaluation program is 
diagrammed in Figure 1. Two basic types of- data output available were 
grouped data and individual -data; The- grouped data option gave the average 
score of a particular group of CCs (e.g.. all CCs in Division ?) on a selected 
variable, while the indiv'idual option gave the score of alsingle CC on a 
selected variable. 

Displays of da,ta were available at three levels of specificity: 

a. Item data involved -scores on single items; 

b. Category data involved scores on groups of related items (e.g., 
all items on the Division Officer Evaluation related to "Bearing"); 
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4. Training Unit I 
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6. Rank 

7. All CCs . 
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USER SECURIJy CLASS 

1 . Conandfng Officer 

2. Division Officer 

3. Company Commander 

4. System Monitor 
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Select Suinmary Variable: 

1. CC Behaviors ^ 

2. _ CC Performance 

3. ' CC Perceptions 

4. RTC System data 

5. Recruit Mtitudes 
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See Silnary Variable 
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Select Item 
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See Item 
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Figure 1. Evaluation Program Flow Diagram 
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1 . See Data Currency 
by Division , 

2. See Data Currency 
^ by Training Group 

3. ' See Data Currency 

by Training Unit 

4. Form a New 

. Training Unit 

5. Modify Training 
Unit Information 

6. Jnput Recruit 
(Juestionnaires 

7. Input Division 

' Officer Questionnaires 

8. Input CC 
Questionnaires 

9i Input T.U. Outcome 
Data 
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c. Summary data involved total scores from a given source (e.g., total 
Score from Division Officer Evaluation). 

As depicted in Figure 1, the amount of data displayed depended on the^ 
security' class of tfie user. The Commanding Officer (and other authorized 
personnel) could se^ all ..system data. DOs.could see all <data on CCs in their' 
divisions* CCs could see all the data which pertained to them. A password 
security sys^tem prevented any user from seeing data which was not within his 
security class, ^ 

The Systems Monitoring component provided the information by which the 
system operator determined which data needel to be entered iYito the computer 
and the means by which the data wlis entered. 

The outputs were presented on the cathode-ray tube (CRT) screen, ''"and', 
optionally, in hard copy form. All outputs were tailored specifically to the 
users' needs* To this end, RTC personnel were consulted frequently during the 
dssign of the outputs to ensure that they were easily understandabl'^^, and in 
a form most suitable for their intended use. 

An example of an individual CC data output i's provided in Appendix B. It 
shows the scores of a given CC on a groups of category variables, as- well as 
the average scores of all CCs in the division, all CCs of the same rank, all 
CCs in the training group, and aVi CCs at RTC. In addition, percentile scores 
are given to show how the CC compares with other CCs in his division* other 
CCs of the same rank, and all CCs at RTC. 

This type of output was used to po-int out the strengths and weaknesses of 
CCs, so that they might take. corrective action on the weak areas. The weak 
and. strong areas are easily determined from the percentile scores. 

This output 'was. used by DOs for several . purposes including: (a) assisting 
the DO in counseling CCs; (b) providing inputs to official evaluations; (c) 
informiag the DO of the performance of his division.; (d) helping* to determine 
areas of strength and weakness in the division; (e) evaluating the effects of 
any actions taken by the DO. . 

This output can be used by the Commanding Officer and other appropriate 
personnel as a management tool, for us? any time detailed data (both absolute 
and relative scores) concerning any of the variables on the system is 
required. 

An example of a grouped-CC data output is shown in Appendix B, where the 
average scores on several category variables are given, grouped by division. 
It is also possible to sort the data by training, group, training unit, CC 
rank, and CC sex. This type of output, available to the, 'Commanding Off icer 
and other authorized personnel, provides a management aid which is useful any 
time it is desired to compare the performance of various groups of CCs. 

In summary, the evaluation program is designed to give information to the 
Commanding Officer, DOs, CCs, and other personnel (e.g.. Code 40 staff, CC 
school personnel) on the 'performance of CCs and RTC in general, and to eval- 
uate the effects of any changes in RTC operations. 

lO' 
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The evaluation program has some similarity to the RATES (Rapid Access - 

Training Evaluation System ) program once used at RTC. The RATES system also 
used a computer to process attitudinal data.- RATES, however, utilized only 
fairly raw measures of student attitude as evaluation criteria, whereas GETS 
goes beyond this to provide highly^-processed attitudinal data from a variety 
of sources. In addition, GETS relates a wealth oTIte^ential evaluation 
criteria^, also in a highly-interpretabl e form, from a variety of other sources 
(e.g., the organizational performance measures, the performance ratings, the 
demo^aphic data). Thus, the GETS evaluation program is similar to RATES in 
that GETS includes many of RATES features; however, %ETS is broader tjian RATES 
in both the extensiveness of -"'ts capabil ities and the range Cif- its application. 

GONTRIBUTIONS OF THE GOMPUTER. A computer is essential to the- operation of an 
evaluation system such as this since it can: (a) input and store' very* large 
quantidtie's of information; (b) " rapidly perform complex calculations and 
manipulations on this information; arid (c) quickly provide displays a1id out- 
puts whith present the processed information in the moSt usable form. . 

TRAINING PROGRAM ^ 

LESSONS PRESENTED ON GOMPUTER TERMINAL. During previouS-phases of this proj- 
ect, training materials utilizing computer-assisted ifistructibn. were developed 



} 



o 

under four approaches. These were: (1) the skill training approach, (2) the 

behavior training approach, (3) the evaluation approach, .and (4) the case 
1 1 

study approach. Of these, only the first was considered acceptable for oper- 
ational use at RTG at this*' time. The decision to exclude the'^other three 
approaches was based on several considerations. The skil 1 training program 
was the most complete, having been und^r development throughout the history 
of the project. It was also the approach which had the most substantial 
and favorable evaluation results. Resource limitations did not. permit the 
implementation of the other three approaches although they still; have good 
promise for application, given the time and resources netessary to develop 
them further. ^ 

Some modifications were made in the skill training programs as they vjere 
transferred to GETS. These modifications were primarily in two areas. The 
programs were made afiplicable to female GGs (they had been, devel oped for 
males), and the new RTG terminology and practices were, incorporated (e.g., 

"Battalion Gommander": became "Division Officer"). l 

I * ' 



T. Human Resource Management Project Final Report. June 30, 1976, S.F. and G. 
dba Mercury, San Diego, Calif, Contract N-OOl 23-C-Ol 91 (unpublished report). / 

8. See footnotes 1 and 3 on page 5. , ' . 

9. See footnotes 2 and 4 on page 5. ■ 

10. See footnotes 2 and- 4 on page 5. / 

11. See footnote 5 on page 5.' . ' 
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The operation of this portion of the training program is shown in Figure 
2 (blocks 1 through TO). After receiving an introduction to the system, the 
student was given fristruction on the "Three Keys" (Goal Setting^ Instruction, 
and Feedback), ff/i lowed by lessons on each of the "Seven Skills*" A portion 
of the material from the lesson "Concrete" is included in Appendix These 
materials are more fully described in previous reports (see footnotes 1, 3 and 
5). 

Contp^bytions of the Computer. The contributions of a computer to a training 
prograrr< such as this include all of those usually associated with computer- 
assisted "instruction, viz., improved self-pacing of students and' individual i- 
zatjon of instruction; and automatic remediation, testing, data keeping, etc. 
In addition, computer-assisted instruction provides an ^dded benefit in the ; 
a^^ea of interpersonal ski'Ps training, in that the absence of human evaluators 
Juring training provides a relatively nonthreatenihg atmosphere. This is not 
true of some other methods of i'lpstruction in this area, such as role-playing. 

- LESSONS UTILIZING VIDEO TAPE, -The hew tr.aining material developed during this 
phase involved computer-controlled video-tape pr;esentations of CCs and re- 
cruits. These lessons wepe intended to provide. more real-to-life representa- 
tions of the CCs job for training and testing purposes. Video tape was ex- 
pected to be an efficient means of increasing student interest in the training 
as well as transfer from training to the job itself. 

These benefits were expected to result from an increase in the student's 
belief that the sk'ills being taught actually are effective with recruits. The 
•credibility of the instruction should increase because the student can see the 
program skills being performed well and poorly by actual CCs in job situations 
wherein the apparent effects on recruits correspond with the quality of per- 
formance (i.e., the recruits respond well to the good performance and less well 
to the poor performance). The video tapes also were expected to help reduce ;\ 
ambiguity in the instructional concepts by providing concrete- exampl es of their 
implementation. / 

Shadowing. An alternate method of achieving these benefits is practiced at 
RTCs in the form of "shadowing." Here, th^ student observes one or more i^Cs 
performing normal job activities. Whereas shadowing is important for getting 
a general impression of the job, the video tape lessons supplement the 
shadowing experience in the following way's: 

a. Variety - The s1:udent can be shown a greater number and variety of 
situations and approaches for dealing with them on video tape. than would be 
practical with shadowing; 

b. Interpretation - The 1 essons-to-bc-l earned are indicated in tbe video 
tape programs, whereas in shadowing they are generally left to the student's 
self-instructional abilities; 

c. Permanency - Video tape lessons can be used long after the CCs ap- 
pearing 1n them have left RTC, A CC can only be shadowed, of- course, while he 
remains at RTC; 
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Figurfe 2. Training Program Flow Diagram 

d. Standardization - With ; video tape, each student is assured of experi- 
encing the subject matter considered most critical , whereas in shadowing the 
critical ity of the sut?ject^matter is left to chance; 

e. Review - Students can see critical video tape instruction again and 
again, whereas in shadowing thei lesson is often gone before the student is 
ready to s ta r t 1 earn i ng ; 

.f. Improvement - With the video tape programs, the instruction can con- 
tinually be updated and improved., whereas the instructional quality in shadow 
mg varies fairly randomly over time^ depending on the quality of the CCs 
being shadowed; 



ence 
time 



). Efficiency - The video tape lessons "compress" the shadowing ^xperi- 
by editing out nonsignif ican^t events and idle time. 



thus saving Student 



Content of Video Tapes. As shown Figure 2, there were eight video tap^' 
lessons. Each lesson involved several segments of video tape training 
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material (from three to eight). The duration of the segments varied from a 
few seconds to over a minute. The content of the tapes was varied .by showing 
several differfent CCs in a number of different situations. These situations 
involved common activities such as: instruction (on marching, academic 
subjects,, locker stowage, etc.); holding individual and group counseling and 
feedback Sessions; and distributing proficiency awards.- 

FurtheA variation in the content of the video tape raterials was achieved 
by ad_dressihg both positive and negative- aspects of a CCs performance. For 
example, twq vignettp^ were* enacted to emphasize two general type's of commonly 
observed inadequacies among CCs. One type of gaheral inadequacy Was called . 
"wishy washy" because the CC was very attentive to the e^notiohs and morale of 
the recruit^ but not very directive. The other enacted vignette showed a 
"tough guy" type of deficiency^which was just the reverse of "wi shy washy" 
(very directive, but ignoring emotional aspects). All of the other vignettes 
y --were abstracted from video tapes depicting naturally occurri^mg, on-the-job 
^ encounters between CCs and recruits. CCs were selected for taping by the RTC 
if their schedule included Important interactions with recruits\ during the \, 
taping period. After some 'nitial nervousnessv most CCs appeared to feel 
♦ fairly comfortable in the taping situation. Some video tapes were taken from 
•about 30 yards -away from the subjects (with the aid of a wireless microphone 
and telephoto lens) which seemed to hel p decrease the obtrusiveness of the 
video taping activities and thereby the discomfort of the participants. 

Operation of Video Tape Lessons.. As shown in Figure 2, the video tape 
materials were presented to the students, as the final portion of the trair.ing 
program. The textual portion of each lesson appeared on the graphics terminal, 
while the video portion appeared on an adjacent TV monitor. 

The computer automatically control 1 ed all functions of the tape, player, 
freeing the. student to attend to the training material . Introductory mat^r-ial 
for each tape segment appeared on the graphics terminal. This was followed by 
presentation of the tape segment on the video monitor which, in turn was 
followed by questions oh the terminal. After each segment, the student had 
the option of answering the questions or re-viewihg the tape segment first. 
In some cases, a wrong answer to a question would result in the tape segment 
being reshown automatical ly. In many instances, the questions fol 1 owi ng a 
segment would progress from very general to quite specific; first asking the 
student to id^nti fy general skill areas being dispjl-ayed, then asking for iden- 
tification of specific behaviors whi\ch occurred within' the skill areas. 

Contri'butions of the Computer. TKis ^marriage between the computer and the 
video tape represents an advancement to the state-of-the-art in using video 
tapes for instruction in the inter'persohal skills area, as well as for in- 
struction in general.. 

Video taped presentation-s of job performance have been successfully util- 
ized for training purposes for many years. The application qf video tape 
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techniques to interpersonal skill instruction has included areas such as guid- 
ance and counsel ing,^^*^^*^^ Psychiatric therapy, classroom instruction,^^ 

17 18 
group p'^oblem solving, and job interview training. 

The instructional strategies employed in these efforts have ranged from 
merely' shoeing ii continuous video tape to the student with little or no 
orienting instrxictlons to interactive sessions wherein an instructor interprets 
and discusses tHexaction on tfie video tape with the student. The interactive 
strategies provide greater assurance thiat the student urifierstahds the lessons 
contained in"" the video tape. However, this approach is limited by the ability 
of the instructorj and- it requires a considerable investment of instructor 
time. The present appVication . has the advantages of the interactive strategies 
without the limitations in that the computer directs the student's attention 
to critical aspects of the video tape and elicits, evaluates, and corrects his 
reactions to these stimuli. A further advantage of a computer- controlled video 
tape system i s that i t can: locate the desired sections /of tape much more ac- 
curately and rapidly than a human bperator, thus avoiding undesirable breaks 
in the continuity of the lessons* -j - 

COMPUTER SYSTEM ; " ^ 

HARDWARE. The training programs described in the previous section were pre- 
viously implemented '-on the f?LATO IV computer system. It was decided to trans- 
fer this training material to, a new stand-alone, mini-computer based system. . 
The requirements for this new system were developed with the following factors 
in mind: 

a. Ability to exeojte ^n-pf^eviously developed training material. 



12. ■ Kagan, N. Can Technology Help Us Toward Reliability In Influencing Human 
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h. Ability to execute all proposed traini ng material ; especially the CC 
evaluation program and the* video tape trailing materials-. 

c. Cost, , V 

d. Delivery schedule. " . . 

e. System Software capabil itie-s. , 
Programming languages avail able. 

'g. Compatibility with other NAVTRAEQUIPCEN computer equipritent. 

h. Maintenance availability. ^ ' , 

i. Reliability. 

- j. Availability on GSA schedule. 

k. Expandability. ^ • ' 

The system selected was centered ■ around a Data General NOVA -3 mini- com- 
puter. The primary factors influe zing the choice '^i/e re delivery schedule and 
compatibility with other NAVTRAEQUIPCEN equipment. The presence of other NOVA 
computers at NAVTRAEQUIPCEN made possible the programmi ng of much of the 
material prior to the del ivery of the actual system, since transfer of pro- 
grams between NOVA computers is relatively easy. 

Principal components of the system are: 

a. NOVA 3/12 CPU with 32K of MOs'memory. 

b. Data General 10 mega-byte cartridge disc system. 
. c. Data Genieral 60 cps printer/terminal. 

Tektronix CRT graphics terminal,. - ^. 

e. Data General mark sense optical card reader. 

f. Sony VO-2600 video-tape recorder^ with interface to NOVA. 

The hardware system configuration is^ shown graphically in Figure 3. 

The total cost of this system Was approximately $35,000, and maintenance 
costs are approximately $5,000 per year. ' 

SOFTWARE. The software for the CETS system, can be categorizeG into three 
areas: (1) lessons presented on the termi-Jial r (2) lessons using video tape; 



NAVTRAEQUIPCEN IH-300 



f T.V. ^ 

I 

V Moni tor 



4006 TEKTRONIX 
GRAPHICS 



TERMINAL 



DG^MARK 
SENSE CARD 
READER 



SONY 
VO-2600 
VIDEO TAPE 
RECORDER 



r 



"Y NOVA 3 
^ CPU 



60 CPS 
TELEPRINTER 



i 

> 


1 


32K 




MOS 


1 , ( 


MEMORY 





10 MB DISK 
SUBSYSTEM 



Figure 3. Hardware Configuration 



NAVTRAEQUIPCEN .IH-300 



and (3) the evaluation program. A detailed description of the software can 
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be found in another report. 

Lesson?; Presented on uhe Terminal. These lessons had' previously been imple- 
mented on the PLATO IV system. It was necessary to translate them to a form 
compatible with the new system. For this purpose, a major effort w^s. invested . 
in developing a new programming language for the new system very similar to the 
TUTOR language used on PLATO ly. This made the translation process relatively 
easy in that much of the old TUTOR code .could" be typed directly into the new 
system. Also, some of the important characteristics of the TUTOR language were 
retained^ the primary one being programming simplicity. It is relatively easy 
for a non-programmer to learn the language in a short time. 

After a program was written in this new language, it was then fXit through a 
translation program. This program translated the code from the new Ic^ngjage 
into Fortran and AssOTt)ler routines which the computer then compiled and e5re-' 
cuted."> With minor exceptions, the programs operated as they did on the PLATO 
IV system. . ~ . - 

Lessons Using Video Tape. These lessons were also written in the new language. 
However, they included special commands for the operation of the video ta,^e 
player. The computer was able to control all functi-)ns of the tape player 
(play, record, fast forward, rewind, stop, pau'se) through an interface wtlich 
also was designed especially for use in this project. Timing was used t^o lo- 
cate specific points on the tape. For. example, if the next segment to be- 
played was farther along on the tape, the computer would activate "fast . - * 
forward" for the required number of seconds, then "stop"; then "play" for the 
required number of seconds. To find a segment earlier^ in the tape, "rewind" 
would be activated for the appropriate time. ^ 

^ ' ' . - * - ■ •» 

Evaluation Program. Software for the evaluation -program consisted, of programs 

to input, store, manipulate, and display the large amounts of data which were 
involved in the system. Datav^re input through the terminal keyboard and the 
card reader. All data were sorted by training unit number and stored on disk. 
Statistics were calculated on all data, including means, standard deviations, 
z-scores, and percentile scores. These statistics were used in the creation 
of the displays, as shown in Appendix B. As shown in these displays, it was 
possible to group the data in many ways (bv rank,^y division, by training 
group, etc.). Each of these displays. coulff be output on either the CRT termi- 
nal or the printer. - 




19, Appli--Mation Inc. Program Description Document for the Computerized 
Evaluation and Training System. October 1977. ^ " 
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^- ...'SYSTEM IMPLEME^fTA.TION AND EVALUATION 

In addition to^assiJf'ing €h^ an appropriate^evaluation and training system 
"is developed, it is critical- to^th.? success of the project that the new pro- 
gramS be properly iniegrated into the on'going operations at RTC; that they be 
appropria,tely *utxl tzed by RTC personnel ; and that an as,sg|sment be made of the 
contribi'tibn ,ofthis program to the RTC 6nera+-»*ori. 

INTEGRATION INTO RTC ^ 

The integration of GETS into. RTC was facilitated by maintaining a conti»^- 
iial liaisfin betweeH! the users at RTC and the Research and Development (R&D) 
team at NAVTRAEQUIPCEN during the developmental period and by commencing the 
transfer of control of the nev/ training to RTC personnel . The RTC's ability 
to. operate the system* is being facilitated by a system operator's manual which 
outlines operational procedures and by the computer programs which were de- 
signed to facilitate the interaction between the human us^rs and the computer- 
based syrtem* The computer programs assist the integration process in that 
most aspects of the training and evaluation programs operate automatically, 
thus el iminating the need for major deviations from ongoing routines of RTC 
personnel i The operation of the system requires a monitor to be available to 
sist in case of an occasional system malfunction, but routine operating 
pcedures require only about 10 man-hours per week* It should be noted that 
^se 10 man-hours are not a"Il added; effort, in that these roiitine procedures 
irfclude several tasks which were performed by RTC before the introduction 
f: CETS. 

The transfer in system operations has been occurring over a six-month 
period which initiated with demonstrations of the system and is continuing 
-with the^actual operation oT aspects of the system by RTC personnel with 
'NAVTRAEQUIPCEN support as required. 

Some problems were encountered in connection with this integration 
process* Manji^ of thes^ problems are attributable to the rapid transition of 
CETS from research and/ development stages to an operational system* For 
example, haroware and /software malfunctions which were due mainly to the 
early development sta^ge of the system caused some delays in the training of 
CCs and. in the^ proce^^ing of needed data,' and this created problems for the 
RTC staff* However/ the system has become more stable over time, and such 
problems are becoming more infrequent. ^ 

Another area pf difficulty involved the acceptance of CETS by RTC person- 
nel. It took time for word of its purposes and capabilities to spread 
throughout RTC/^vSince it is a radically new means of training and evaluating 
CCs , 'many mistaken ideas about the system arose, especially among CCs them^ 
selves. These mistaken ideas were combated with numerous briefings and 
memoranda from NAVTRAEQUIPCEN and RTC personnel. The use of the system by 
CCs has increased from almost nil at the beginning of the project to about 
50% of available CGs at the present times, and it shows promise of continued 
improvement. Although progress toward CC acceptance appears to be advancing 
well, this area will require constant .vigilance and nurturing, especially 
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until the system loses its experimental . status and becomeis an integral part 
of RTC. 

Acceptance of GETS by other RTC personnel was predicated on somewhat dif- 
ferent considerations than for CCs. One area of concern for these personnel 
,was the lack of (concrete evidence that the current configuration of programs, 
in>the form^of GETS, was having a positive effect on the organization. The 
provision of such evidence is a time-consuming process. It involves training 
or evaluating, a large number of GGs, waiting until they have picked up and led 
subsequent companies, and then evaluating them again. Following this, the 
=data must be analyzed to determine where changes in performance have occurred* 
This process takes several rronths, and tne f rst complete data are just new 
being collected. Some of the necessary evidence concerning the effects of 
GETS will soon be available^ 

UTILIZATION AT RTG 

The training portion of GETS was used by RTG on a routine scheduled basis 
to train prospective GGs, i.e., those who had just completed the standard GG 
school ^a four-week program of lecture-oriented classes). Following the com- 
puter-assisted training, the CG students entered a period of shadowing. After 
a few weeks of shadowing, they were given their first training unit (T/U.) to 
lead. This ijnvolved preparing 70-80 recruits, in an eight-week period, to be 
capable, of assuming life in the Navy. 

The evaluation portion of the system came into play at the end of the 
training period, when all inputs (Table 1) were collected and processed. Each. 
GG was encouraged to come to the computer and look at his/her data, in order 
to become aware of his/her woak and strong points. RTC and NAVTRAEQUIPCEN 
personnel v/ere present to instruct CCs in use of the evaluation system, and to ^ 
suggest steps which the GGs might take to improve their performance. 

In addition to the mainly scheduled utilization by new CCs, the system was 
also used by other RTG personnel in a variety of Wdys. For example: 

a. Experienced CCs looked at data from their training units to determine 
their strong and weak points. 

b* Data from the system have been used by GG school personnel to assist in 
the counseling of CCs. 

c. The Director of the Standards and Evaluations Department has made ex- 
tensive use of data outputs to investigate questions ;uch as: 

(1) how do variables such as age, rank, rate, etc. relate to GG per- 
formance? - 

(2) what variables determine a GC's attitude toward GG school? 

(3) what variables are related to the differences in the performance 

of the various divisions? ■ 

* 

d. The GETS data has been used to help select the "Sailor of the Month." 
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ASSESSMENT AT RTC ^ • 

The GETS system was evaluated , j*n a preliminary analysis, from "several 
points of view du»:jng the period of transfer of coatrol from NAVTHAEQUIPCFN 
to , RTC. Results from this evaluation are categorized as follows: 

a. Attitudes of the RTC staff (CCs, DOs, CC school personnel, and others 
*who used the system) . toward the' system. 

b. Amounts ot use made of the various components o:" .the system. • 

c. Cost savings resulting from use of the system. 

ATTITUDES OF RTC STAFF.. The majority of the attitude data came from studel.^ 
CCs who went through the training portion of the system. . A total of 18 stu-^ 
dent CCs have completed theXtraining to date. Each student was given two 
attitude forms during traini.ng;'^one, after the training materials which ap- 
peared on the terminal , -and one after the video tape training. The questions 
and results are shown in Table 2, . ^ . 

Table 2 shows that, bn Form I, the^ students msidered the instruction to 
be interesting (#1) and useful to them' (#2). Th» re was a tendency to say 
that, as a result of the instruction , they were moi^e able (#3) and more 
likely (#4) to perform the skil 1 s that were taught. They also thought that 
RTC would be improved if more of its personnel used the skills (#5), 

Form II shows that the video-tape. material s improved the responses on four 
of the five items, although none of the differences was statistically signifi- 
cant. Also, the results on items 6 and 7* show thaj: the video tape programs 
increased the enjoyment and perceived effectiveness* of 'the training beyond 
that of the printed material alone. Across both forms, 76% of the responses 
were favorable, 3% unfavorable, and 21% neutral.' 

Much improved picture and sound quality are possibte in the video tape 
materials, and some criticism from students and other "^RTC personnel was 
directed at these elements. It is encouraging to note, however, that the 
advantages of the video tape approach were sufficiently impressive so as to 
elicit favorable overall attitud_es in spite of these technical shortcomings. 
.Further , most of the taping problems were due. to the inexperience of the 
researchers in video taping techniques. The preparation of good quality 
sound and video should be much less a problem now that such experience has 
been attained. 

No formal measures were taken of attitudes of others on the RTC staff. 
However, judging from the extensive utilization by non-CC personnel (see next 
section), it can be assumed that the system was perceived as a useful tool. 

'MOUNT OF USE.- The computer kept track of the amount of time that the system 
was used by various categories of personnel. Also, detailed use data was 
kept on the student CCs. They were scheduled to use the system. for two nours 
per day each until they completed the training. They took an average of 5.0i 
hours to complete the training (range 4.07 to 7.87). 
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ITEM 



TABLE 2. . CC STUDENT ATTITUDES 

FORM I 
MEAW 



FORM 11 
MEAN 



DIFFERENCE 
(II-I) 



1. The recenj experience -with ' the GETS 3.94 3.88 
program was: (5 = fascinating, 3 = neither , 
liked nor disliked, 1 = a bore) 

2. The recent experience with the GETS 4.12 4>31 
program is: (5 = very useful, 3 = neither 

useful f)or useles's, 1 = useless) 

3. I think that I am more able to perfoVni 3.44 3.81 
the skills of the GETS program as a result 

of my recent experiences with the program. 
"(5 = strongly agree, 3 = unsure, 1 = strongly 
disagree) 

4. I think that I am now more Jikely to '3.5G 3.75 
actually use the skills of the GETS program ,^ - ^ 

as a result of my recent experiences-^^^ith 
the program. (5 = strongly agree, 3 = 
unsure, 1 = strongly disagree) 

5. RTC would be more effective if more of 3.^4 4.06 
its personnel would use the skills taught 

in the GETS training program.- (5 = strongly 
agree, 3 = unsure, 1 = strongly disagree) 

6. Without the v .deo-tape materials, the NA** 
GETS program would have been less enjoyable. ^ - 
(5 = strongly agree, 3 = unsure, 1 = 

strongly disagree) ' 

7. Witbout the video-tape materials, the NA* "4.19 
GETS program would have been less effective. 

(5 = strongly agree, 3 = unsure, 1 = strongly 
disagree) - 

* Not Applicable 



-.06 1 



+ .19 



+ .37 



>+.25 



+.12 



4.25 ^ NA* 



NA^ 



A total of 36 -experienced CGs used the system for an average . of 22 minutes 
each, primarily to look at their evaluation data.. Most of this use occurred 
in the last couple of weeks of the threje- month period of oiserational applica- 
tion. Usage by other RTQ staff members is difficult to categorize accurately. 

for data would often come> from one person, but 
on the computer to output the data. For example, 
charged to NAVTRAEQUIPCEN staff members was actually 



This is because a request 
another person would sign 
much of the computer time 



used to fill requests by RTG pe^-sonnel for data. 



However, an overall estimate of the time that the system was in use by (or 
for) RTC staff personnel other than 'CGs is 130 hours and this too is increasing 
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at an accelerated rate. Personnel using the system included the Coimianding 
Officer, Military Training Officer, Director of Standards and Evaluations, 
division officers, and CC school personnel. 

cOST SAVINGS RESULTING FROM USE OF SYSTEM. The best indicators of the cost- 
effectiveness of the GETS system appear to involve the post-RTC performance of 
recruits and the speed of their progress through RTC. Except for attrition 
rates and to some extent perhaps recruit competition scores, such measures 
generally are not avail a'^le. Many of the variables that can be related to the 
ultimate cost-effectiveness of a program at RTC either are almost inextricably 
enmeshed in the complexities of the Navy system or have a somewhat question- 
able connection to fiscal considerations. 

Examples of some cost-related variables at RTC that are difficult to " 
measure due to system complexities are the time saved and the problems solved 
due to the availability of data from the evaluation programs. To determine 
the nature of .such effects, one would need to know what data were used from 
• the GETS system, how much resources would have been required to get these data 
by other means, what actions were made possible by virtue of the availability 
of the data, and what would have been the consequences of not taking these 
actions. It appears that valid information of these kinds would be difficult 
to obtain. However, an evaluation effort in this direction will be made in 
the ongoing evaluation of GETS. 

The attitudes, morale, and motivations of RTC personnel are also difficult 
to measure accurately and there is, additionally, a less clear-cut relation- 
ship between these measures and cost considerations. In some of the earlier 
referenced reports on this project (Spencer, et. aK, 1975, Hausser , et. al., 
1976, Lukas, et* al.,.1977), it was noted 'jhat the recruits of better CGs 
(i.e., those who were rated higher by their supervisors; who had companies 
with higher competition scores and lower attrition; and who performed at. 
higher skill levels as judged by their recruits) were significantly more 
likely to report favorable attitudes, morale, and motivations than those of 
lower-rated CGs* These findings support the notion that these affective 
measures are indeed measures of recruit qua-lity; Thus, in the absence of some 
of the more direct cost-effectiveness measures, affective data can contribute 
to the picture of RTG operations from which cost effectiveness can be in-- 
ferred. Sufficient affective data are not, yet available to support an infer- 
rence about the present cost effects of GEts. Based on findings from the 
earlier research on this project, however, it is expected that such effects 
' due to GETS will be positive. % 

^ Tangible evidence of cost-savings is obtainable where GETS is. substituted 
for a less efficient manner of performing a job. If the tasks performed by 
GETS were to be attempted manually, many times the resources wo6ld be required 
to provide services that would only be poor approximations to the accuracy, 
^ comprehensiveness, and speed of the GETS system. Unfortunately, however, most 
' of the tasks performed by GETS either were not performed previously at RTC or 
a substitution approach to its evaluation was not employed. 

One area where GETS was substituted for a previous procedure, however, is 
^ that of t+ie processing of "recruit critique sheets,^' Performed manually, this 
operation required about, six hours a week to process about 1/5 the data as is 
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now being processed automaticany by GETS. Thus, GETS is providing more sub- 
stantial information in seconds vice hours. Continuing attention will be given 
to other opportunities at RTG to .replace a less efficient operation with the 
automatic capabilities of GETS. 

A prime exa-iple of this is the potential of replacing some portions of the 
regular CC training ^program. The costs of the time that instructors normally 
invest into t!ie teaching taken over by GETS could.be deducted from the costs 
of GETS, thusly further contributing to its cost-effectiveness. 

The pursuit of cost-effectiveness evaluations typically is considered un- 
wieldly if not impractical for areas such as the present one (involving leader- 
ship, interpersonal communications, etc.). However, the criticality of the 
findings and the potential for contributions to a general methodology for con- 
ducting such investigations require continued efforts in this direction. 
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SECTION IV 

CURRENT ACTIVITIES AND FUTURE PROPOSAllS 

Ongoing j^ctivities consist of completing the development of the evalua- . 
tion program; continuing the testing, refinement, and further development of 
the training programs; and initiating the evaluation of the total system^ 

EVALUATION PROGRAM 

Plans for FY 78 efforts at extending the evaluation program include: 

a. Addition of a remediation feature to the CC outputs which will suggest 
actions to be taken to correct any deficiencies uncovered by the evaluation 
(i.e., going through portions of the skills training programs, counseling with 
the DO, etc.) . ^ 

b. A computer-based procedure for weighting and combining various evalua- 
tion variables for obtaining global {and perhaps official) evaluations of CC 
performance. 

c. Revalidation of evaluation variables. 

d. Statistical tests (e.g., t-statistics , correlations, regression analy- 
sis, analysis of variance) to determine the statistical significance of rela- 
tionships among variables. / ^ 

e. Graphical displays of relationships ambng variables. 

f. Displays which compare existing groups (e.g., divisions, ranks, male/ 
female) on' their scores for all variables. 

g. Automatic printouts of messages to personnel requesting updating of 
data for the evaluation program. 

h. Scheduling of official MED inspections. ; 
TRAINING. PROGRAMS ' 

Further development of the training programs will include: 

a. Continuing refinement of existing programs based on data from current, 
users. • ' 

b. Improvement of sound quality and computer control of existing video 
tapes. 

c. Development of a ^program in which the computer assists judges to eval- 
uate video taped perfonnance^r:and to provide performance feedback to the people 
who are the subjects of the video tapes. 



ERIC 



25 

^ . • 29 



NAVTRAEQUIPCEN IH-300 

• SYSTEM EVALUATION 

Current procedures for evaluating the GETS system involve determining who 
uses the various components of the system, how they use it, their attitudes 
toward it, and' the impact of the system on the behavior and performance of 
recruits and CCs, and on organizational effectiveness. 

FUTURE PROPOSALS 

Proposals for the further use and expansion of the GETS system will be 
basied on feasibil ity a^'^J cost-effectiveness estimates of such applications as: 

a. Scoring and stHnnarizing recruit test performances and incorporating 
these data into the current evaluation program^ for further processing and ^ 
analysis (as is done wi \.h the current variables). ^ 

b. Collecting and analyzing data gn prospective CC school candidates for ^ 
the purpose of tailoring CC training to the individual. 

c. Collecting and analyzing fleet data on the performance of recruits 
after they leave RTC as an additional source of management information.. 

, d. Computer administration of major portions of the CC training program 
as currently conducted at RTC. 

e. Implementing an in-depth program for assisting RTC personnel in the. 
proper interpretation and uti 1 ization of data from the evaluation program. 

f« Collecting and analyzing data related to other variables or positions 
at RTC, and administration of similar training to other positions at RTC 
(e.g., classroom instructors). 

g. Employing the video-tape capabilities for providing feedback to CCs 
on their owri on-the-job performances. 

h. Creating video-tape instruction for administration to large groups of 
students. • li 

i. Applying the computer system to the management of instruction for re- 
cruits (thusly allowing each to progress at his own pace through some parts of 
RTC). 

j. Giving recruits brief exposure to CAI (to prepare their for the type of 
tifaining many of them will receive after RTC). 

k. Performing many of the training analysis functions of the data analysis 
department at RTC* 
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SECTION V . 

DISCUSSION ^ ' 

This project demonstrates some rather novel capabilities and applications 
of an instruct Ion- oriented,- computer-based system at an RTG. It also 
demonstrates some atypical approaches to training, evaluation, and management 
in the "interpersonal -communication^ area. The demonstration is cpfisidered 
introductory because the system can do much more at relatively little addition 
al cost; thus increasing its post effectiveness. It is introductory also be- 
cause, as for any new approach, continual evaluation and refinement is required 
to assure maximal exploitation of existing capabilities. The arguments for 
the us6 of the system as is and for expanding its use further are based on the 
benefits already achieved and on those expected from future efforts . 

The expected future benefits were addressed in Section IV of this report. 
The benefits already achieved include results obtained, from the three previous 
evaluations of materials related to this project as well as the findings of :he 
current evaluation. The previous research (which was ider.tical in many- aspects 
to the present research) has found the following effects due to the training 
program: (1) improved behaviors in CCs; (2) improved attitudes in recruits; 
(3) some evidence of improved performance in recruits. 

The ctirrent research provided some critical data on the operability and 
acceptability of the present version of the computer-based programs for 
training, evaluation, and management functions at RTC. First, the favorable 
attitudes of the students (Section HI) provided evidence for the acceptabil- 
ity and face validity of the instructional components^ Second, the data con- 
cerning the use of the evaluation program indicated that this component of the 
system^is ^^weH.,.on^ i ts^^w fulfilling its intended functions. This feature 
was intended to be used as a management tool for , diagnosing problem areas 
prior to action; as a basis for determining action; and in evaluating the 
effects of actions after they are implemented. Although RTC is just beseeming 
familiar with this capability and much of the data base still needs to be 
acquired for some of5erations, the evaluation system has already been used 
extensively for a variety of purposes (Section HI),. 

In addition to being effective, the programs are efficient, due mainly to 
the computer. The computer plays a central and critical role in all pha?.is of 
the current system, as was explained .in Section II ("contributions of the com- 
puter"). Some of the expected cost benefits or those already noted or infer-^ 
red have been described in Section III. Thus, considering the benefits al- 
ready apparent, the costs of operating and maintaining the system (detailed in 
Section II) appear to be justified. The justification for a System such as 
this becomes even more compel 1 ing when one considers the potential benefits to 
be derived from additional applications of the system. These additional ap- 
plications would be relatively easy to accomplish now that the basic system is 
operational . . 
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APPENDIX A 
DATA COLLECTION SYSTEM 

• ■ . ^ 

/ • RECRUIT SURVEY •. :. 

The following pages -contain questions about you, your CC, and the Navy in 
general* Answer each question by making a mark on the NAVTRALQUIPCEN answer 
form which you have been- given. Mark the form as follows: 

A if you strongly agree with the statement. 

B if you agree with the statement. 

C if you neither agree nor disagree with the statement. 

D if you disagree with the statement. 

E if you strongly disagree with the statement. 



Exampl e : 



If question 1 said "Florida is hot in the suniner" and you strongly 
agree with this, you would make a mark in the A column after number 
1. ^ 



B 



D 



E 



Make your marks with' a black penc.il. Do not put your name on the answer 

form, but do fill in your company number and day of training. Your company 

commander will not know how you answered. He or she will only see the average 
answers given by the entire company. 



GENERAL 



a. 3 KEYS 



C. 7 SKILLS 



1. 
2. 
3. 
4. 
5. 
6. 
7. 
8, 



10. 
11. 



COUNSELING 
MOTIVATING 
'iNSTRUtTIffG 
RESPECT FOR CC 
GENERAL MORALE 
LIKING FOR BOOTCAMP 
ESPRIT DE CORPS 
INTENTION TO RE- 
ENLIST 

EXPECTED LIKING OF 
NAVY 

VALUE OF TRAINING 
REWARD & PUNISHMENT 



1. GOAL SETTING 

2. INSTRUCTION 

3. FEEDBACK 



1 . CONCRETE 

'2. TIMELY 

3. CLARIFYING 

4. REASONABLE 

5. RELEVANT 

6. CONSIDERATE 

7. HUMAN 



Figure A-1 . Recruit Survey 
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A 


B 


C 


0 


E 






NEITHER 




Strongly 


STRONGLY 




AGREE NOR 




AGREE 


AGREE 


DISAGREE 


DISAGREE 


DISAGREE 




Clarifying 



Reasonable 



Relevant 



Considerate 



Human 




My CC tells us what goals we are supposed to reach. 

My CC gives us instructions which are complete* 

My CC gives us enough information on how well we are doing. 

My CC gives very specif ic detail s when explaining something, 

My CC demonstrates things to us to help us learn. 

My CC gets our full attention when talking to us. 

My CC. explains things to us so that we don't forget. 

My CC lets us know what things are most important. 

My CC encourages us to ask questions aboiit things we don't 
understand. ^ 

My CC asks us questions to see if we understand things. 

My CC doesn't expect too much from the training unit. 

My CC is not too easy on us. 

My CC gives us good reasons for the things we do. 

My CC tells us how the skills we learn at RTC are going to 
make us better sailors. 

My CC treats us like human beings. 

My CC .le*,s us know that he has confidence in us. . ; 

My CC is patient with us. 

My CC calls us by our own names. 

My CC admits; it when he doesn't know something. 

My CC tells us about his experiences in the Navy. 

My CC has a good sense of humor. 
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A 


6 


C 


' -IT - 


E 






NEITHER ' 






STRONGLY 




AGREE NOR 




STRONGLY 


AGREE 


^GREE 


DISAGREE 


DISAGREE 


DISAGREE 



Human 




Reward and^ 
Punishmant 



... -22. 

23, 
24. 

25. 



>26, 
Respect for<' 
CC >27, 



Counsel ing 




Motivating 




37. 

Instructing - 38. 



My CC takes part of the blame when the training unit does 
poorly on something. 

My CC really Cares about how the training unit does. 

My CC gives the right amount of rewards and praise to 
recruits when they deserve it. 

My CC gives the right amount of discipline to recruits 
when they deserve it. 

My CC is one of the best .at RTC. 

I have great respect for my CC. 

"My CC can be informal with recruits. 

My CC makes <every effort to help recruits who are. having 
personal or motivational problems. 

My CC really 1 istens to recruits in order to understand 
their problems better. 

My CC tells recruits what they can do or where they can 
go to get help with their problems. 

My CC looks out for the welfare o-^ the recruits. 

My CC does not harass or belittle recrCiits. 

My CC treats recruits in a consistent manner. ' 

My CC is firm in enforcing rules and regulations. 

My CC shows a sincere concern for each recruit in the 
training unit. 

My CC does not play favorites among recruits. 

My CC sees to it that individual instruction is given to 
recruits who need it. 



Motivating - 39. The RPO's in my training unit do their jobs well. 
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A 




r— — 


. D 


E 






NEITHER 






STRONGLY 




AGREE NOR 




STRONGLY 


AGREE 


AGREE 


DISAGREE 


DISAGREE 


DISAGREE 



6en. Morale - 40. 

Liking for - 41 . 
Boot Camp 

Esprit de - 42. 
corps 

Intention - 43. 
to re-enl ist 

Expected - 44, 
Liking of the 
Navy — 45. 



Value of 
Training 

Expected 
Liking of 
the Navy 



- 46. 

- 47. 



My morale is very high. 

So far, I like boot camp a lot. 

I have great pride in being in the Navy. 

I expect that I'll probably re-enlist when niy first hitch 
is up. 

After boot camp, I expect that I will like the Navy. 

I am encouraged about vny chances of getting ahead in the 
Navy. 

I think that the training I am receiving at RTC is valuabl 

I am 'enthusiastic about the training I will get after RTC. 

Figure A-1 . Recruit Survey (Cont'd) 
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DIVISION OFFICER EVALUATION 



The following form contains statements about the Company Comnanders 
Division. Answer each statement by making a mark on the NAVTRAEQUIPCEN 
card which you have been given. Mark the card as follows: 

A if you strongly agree with the statement. 

B if you agree with the statement. 

C if you neither agree nor disagree with the statement. 

■ D if you disagree with the statement. 

~ if you strongly" disagree with the statement. 



m your- 
answer 



Example: If question #1 said, 
agree with this, you 
number 1 . 



•'Florida is hot in the summer" and you strongly 
would make a mark in the "A" column after 



B 



D 



Make your marks with a black pencil. Do not put any names on the answer^ 
card, but do fill in the Training Unit number of the Company Conmander you are 
rating, and the day of training. 

For the final item, #31, mark the form as follows: 



A if you 
b if you 
C if you 
"TT" i f you 
i f you 



thi nk the CC i s ou^ standi ng. 
think the CC is superior , 
think the CC is ^cod. 
think the CC is average , 
think the CC is bel ow average. 



I. DIMENSIONS; 



A. BEARING 

B. RELIABILITY 

C. ADAPTABILITY 
0. INITIATIVE 



E. COOPERATIVENESS 

F. COUNSELING 

G. MANAGEMENT 

H. PROBLEM SOLVING 



I. DISCIPLINE 

J. OVERALL QUALITY 

OF T.U. 
K. OVERALL EVALUATION 

OF CC 



Figure A-2. Division Officer Evaluation 
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A 


& 


C 

NEITHER 


D 




STRONGLY 




AGREE NOR 




STRONGLY 


AGREE 


AGREE . 


DISAGREE 


DISAGREE 


DISAGREE 



DIMENSION 

C - 1. Adapts to new policies and procedures. 

G - 2. Knows who is responsible for each job. 

D - 3» Performs his/her job with enthusiasru. 

G - 4. Keeps recruits productively busy, 

E - 5. Does not resent being told what to do^ 

I - 6. Division staff does not have to bring order to his/her Training 
Unit when he/she is not present. 

E - 7. Solicits assistance from staff members when needed. 

J - 8. ^as done well in teaching recruits the knowledge and skills 
required to be good sailors. 

D - 9. Gives 100% effort to his/her job. 

F - 10. Makes every effort to counsel individual recruits who are having 
motivational or personal problems* 

A— 11. Reports for duty in appropriate physical and mental condition. 

H - 12. Makes efforts to solve problems rather than just grumbling about 
them. 

C - 13. Does not become frustrated in demanding situations. 

H - 14. Does not discourage easily when working on problems. 

J - 15. Has instilled in recruits the proper attitudes for becoming fleet 
personnel. 

B - 16. Takes action without letting things slip. 

B - 17. Makes sjjre his/her Training Unit is punctual. 

I - 18. Does not send recruits to Division staff when he/she could have 
handled them. 

G - 19. Makes the best use of his/her time. 



Figure A-2. Division Officer Evaluation (Cont'd) 
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A 


5 


C 

NEITHER 


D 




STRONGLY 




AGREE NOR 




STRONGLY 


AGREE 


AGREE 


DISAGREE 


DISAGREE 


DISAGREE 



A - 20. Wears uniform properly and is neafy groomed. 

6-21. Sees to it that all forms, records, reports from his/her Training 
Unit are done properly and on time-. 

G - 22. Has done an effective job of organizing his/her Training Jnit. 

C - 23. Adjusts to changes in schedules. 

D - 24. Takes appropriate action without having to be told or ordered. 
A - 25. Conducts h imsel f/hersel f in a respectful m^'litary fashion. 
B - 26. Follows orders promptly and efficiently. 

J,- 27; His/her training unit appears well trained when you see them on 
the street. 

H - 28. Recognizes the significance of problems. 

I - 29. Has not had excessive discipline problems in his/her Trainirn 
Unit. 

E - 30. Willingly helps other staff members. 



Key for 


A 


3 


C 


b 


/ E ■ 


Item 












#31 


OUTSTANDING 


SUPERIOR 


GOOD 


AVERAGE 


BELOW AVERAGE 



K - 31. Overall, J would rate this Company Comnander: 

Figure A-2. Division Officer Evaluation (Cont'd) 
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COMPANY. COMMANDER SURVEY 

The following survey is part of a project which is being conducted jointly 
by RTC and NAVTRAEQUIPCEN. The project has been names "CETS." for Computer- 
ized Evaluation and Training System, The questions on this survey cover 
several areas: First, there are some personal background questions, then 
there are attitude questions concerning CC school, RTC, recruits in general, 
your division, and genieral job conditions. 

The results of this survey will be used along with results of a D. 0. 
Survey and a recruit survey to identify and correct weaknesses in company 
commanders, CC training, or RTC in general. 

The first four questions are background questions. Answer these questions 
by putting a mark 1n the box on the NAVTRAEQUIRCEN answer card which corre- 
sponds to your answer. For the rest of the items, select a letter according 
to whether you agree or disagree with the statement. 

A if you strongly agree with the statement. I 

B if you agree with the statement. 

C if you neither agree nor disagree with the statement. 

D if you disagr ee with the statement. 

E if you stronf jTy disagree with the statement. 

Example: If question #12 said, "Florida is hot in the summer" and you strongly 
agree, you would mark the card in the "A" column after #12. 

A B C D E 
12. • = = 

In the space at the top of the card marked "Company Number," write the 
number of your present or most recent Training Unit. In the space marked "Day 
of Training," please write the date that you are doing this survey. 



A. RTC ATTRIBUTES: ^ 

1. , QUALITY OF CC SCHOOL 5. RESPECT FOR RECRUITS 

2. QUALITY OF RECRUITS 6. JOB CONDITIONS 

3. QUALITY OF DIVISION SUPPORT 7. ATTITUDE TOWARD BEING 

4. VALUE OF TRAINING ' A CC 

Figure A-3. Company Commander Survey 
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COMPANY COMMANDER BACKGROUND QUESTIONS 

1. How old are you? a) 20-25 

b) 25-30 

c) 30-35 

d) 35-40 

e) 40 + 

2. How long have you been in the Navy? a) 0-5 

b) 5-10 

c) 10-15 

d) 15-20 

e) 20 + V 

3. What is the largest number of persons you have supervised before 
becoming a CC? a) 0 

b) 1-5 

c) 5-10 

d) 10-20 

e) 20 + ' * 

4. Did you volunteer for GC duty? a. yes b. no 

For the rest of the questions, select a letter according to whether 
you agree or disagree with each statement. 



A 


B 


C 

NEITHER 


D 


E . 


STRONGLY 




AGREE NOR 




STRONGLY 


AGREE 


AGREE 


DISAGREE 


DISAGREE 


DISAGREE 




5. CC school prepared 

^--CCschool prepared 

7. CC school prepared 

Quality 8. CC school prepared 
of CC 

Sclv)ol 9. CC school prepared 



;Itoo1 9. 
\ 10.: 



CC jschool prepared 

IK CC school prep-^red 

12. CC school prepared 

13. CC school prepared 



procedures . 



me well in the area of maintaining discipline, 

me well in t^e area of counsel ing Y^cru its. 

ma. well in the area of motivating recruits.^ 

me well in the area of infantry. 

me well in the area of barracks. 

me well in the area of personnel. 

me well in the area of lockers. 

me well in the area of academics. 

me well in the area of RTC poltcies and 
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A 


B 


1 A 1 

c 

NEITHER 


D 


E 


STRONGLY 




AGREE NOR 




STRONGLY 


AGREE 


AGREE 


DISAGREE 


DISAGREE 


DISAGREE 



— 7-' — 

. I think that the training recruits receive at RTC will be valuabli 

Value to them later on in the Navy. \ 
of \ 

Train-' 15, Because of training recruits, I have developed .rore confidence 

ing and self-respect, - 

_i ; \ 

16. Being a CC is a job that continual ly allo^//s me to learn something 
worthwhile* 

y7. My work as a CC is interesting enough to talk about with people 
not involved in recruit training. 

Atti- ^ 

tude 18. I prefer the work of a CC compared to other jobs. 
Toward 

Being 19» I feel that my performance as a CC is an important and vital 

a CC service to the Navy. 

(ATBCC) ^ ' ) 

20. It is important for me to be an outstanding CC. 

21. I am proud to wear the red aiguilette. 



Respect 22. I have a great respect for my recruits, 
for 

Re- 23. I have a lot. of confidence in my recruits. 
£r^its 

Quality 24* My recruits are an asset to RTC and the Navy. 
of 

Re- 25. Recruits presently at RTC are easy to .teach* 
cruits 

^6. I get help from Division Staff members whenever I need it. 
Quality 

of 27. It is easy to talk with Division Staff members about problems I 
Divi- having with my job* 

si on 

Support 28. I have a lot of confidence in the Division Staff. ^ 

29. The policies of my present Division are fair. 

30. My supervisor keeps me posted on how well I'm doing. 



Job 31. I'm satisfied with, my chances for .advancement at RTC. 
Condi- 
tions 32. It's not who you know, it's what you do that gets you ahead at RTC 



33. Most of the* policies and procedures at RTC make good sense. 



Figure A-3. Company Connmanuer Survey (Cont'd) 
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A 


B 


C 

NEITHER 


D 




STRONGLY 




AGREE NOT 




STRONGLY 


AGREE 


AGREE 


DISAGREE 


DISAGREE 


DISAGREE i 



Job 34. Changing policies and procedures when you change divisions is not 

Conditions a great problem. 

ATBCC 35. The rewards for doing a good job at RTC are adequate. 

Quality 36. I've never felt that my superiors were out to get me^ 
of Di- 
vision 37. I do not get conflicting instructions on how to perform my job 



Support 



38. Do you have any particular suggestions concerning any a spect of 
RTC or any comments concerning the foregoing questions? (Please 
detail your suggestions and advise why you feel as you do in the 
space provided below.) . ' 



Figure A-3. Company Commander Survey (Cont'd) 



RTC SYSTEM DATA 

Company Commander: Rank 

Rate 

Training Unit: Size on formation ' 

Number of recruits added 

Number of re- recycled recruits 

Number of recruits sent to another T. U. 

Number of recruits sent to a special T.' U. 

Total setbacks at graduation 

Size at graduation 

Average word knowledge/arithmetic test score 
Number^^of street marks 
. • • Number of recrui^^prof iciency badges 
- - MED final barracls average 
MED final infantry average 
MED final locker average 
MED final personnel average 

Figure\A-4. RTG System Data 
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APPENDIX B 



EXAMPLES OF DATA OUTPl/l 



SUMMARY VARIABLE: 
"COMPANY COMMANDfR:" 



INDIVIDUAL DATA 

"RECRUIT SURVEY" 
BMC XXX 



CATEGORY 


j/U . XX 

/ 


DIV. X 


ALL E- 


-7Vs 


ALL CC's 


T.G. 


1. 


CONCRETE 


/ 3.911 


4.123/ 49^ 


4.244/ 


9% 


4.177/ 


45% 


4.114 


2. 


TIMELY / 


4.211 


4.135/ 50% 


4.261/ 


41% 


4.165/ 


50% 


4,034 


3, 


CLARIFYING / 


3.621 


3.706/ 50% 


3.834/ 


23% 


3.808/ 


46% 


.3.716 


4. 


REASONABLE 


.2.992 


2.843/ 51% 


2.819/ 


91% 


2.835/ 


55% 


2.784 


5. 


RELEVANT / 


3.790 


3.841/ 50% 


3.893/ 


36% 


3.828/ 


50% 


3.761 


6. 


CONSIDERATE 


3.280 


3.744/"" 46% 


3.954/ 


3% 


3.935/ 


35% 


4.004 


7. 


HUMAN 


4.065 


3.940/ 51% 


4.070/ 


50% 


4.048/ 


50% 


4.048 


8. 


GOAL SETTING 


3.772 


3.914/ 49% 


4.074/ 


12% 


3.995/ 


45% 


3.827 


9. 


INSTRUCTION 


3.863 


4.110/ 49% 


4.287/ 


8% 


4.156/ 


44% 


4.051 


10. 


FEEDBACK 


3 J 84 


3.702/ 45% - 


3.881/ 


3% : 


3.785/ 


36% 


3.721 


n. 


COUNSELING 


3.832 


3.775/ 50% 


3.828/ 


50% 


3.853/ 


50% 


3.851 


12. 


MOTIVATING 


3.349 


3.649/ 47% 


3.778/ 


3% 


3.750/ 


41% 


3.679 


13. 


INSTRUCTING 


3.538 


3.720/ 49% 


3.800/ 


16%. 


3.781/ 


45% 


3.727 


14. 


REWARD & PUN 


3.606 


3.695/ 50% 


3.845/ 


23% 


3.722/ 


48% 


3.521 



Type 'B' to return to thejist of CC's in your division, -CNTRL P- to 
print this page, or type the number of the category to see the itens 
which make up these scores;. 

NOTE: For reasons of data security, the data shown are not actual, current 
aata; but are from a developmental test of the system. 

Figure B-1 . Individual Data 
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mm VARIABLE ALL OIV A ' DIV B DIV C DIV D DIV , E 

1. CONCRETE , 4.051 4.209 3.968 3.844 

0.495/ 40. ,0.295/ 6. 0.760/ 5. 0.468/ 6. 



2. TIMELV 4.128 .1 4.210 3.937 3.974 

40. 0l346/ 6. 0.585/ 5. 0.242/ £ 



3. CLARIPyiNG 3.614 3>9 3.544 3.348 

" 0.493/ 40. 0.297/ 6. 0.651/ 5. 0.483/ 6 

4, REAaBLE ' 2.894 2.799 2.904 2.968 

40. 0.207/6. 0.241/ 5, 0.248/ g 



5. RELEVANT 3.664 3.899 ^ . 3.514 , 3.432 

0.513/ 40. 0.348/ 6. 0.740/ 5. 0.497/ i 

6. CONSIDERATE 3.766 3.864 3.956 3;597 

0.510/ 40. 0,476/ 6. 0.477/ 5. 0.474/ £ 

7. HUMAN \ , 3.860 4.118 3.705 3.790 

; 0.534/ 40. 0.297/ 6. 0,884/ 5. 0.502/6 

i\ 

8. GOAL SETTING . i \ 3.964 4.114 3.748 3.738 

!\0,449/ 40. 0.3U3/ 6. 0.645/ 5. 0.344/6 

9. INSH^UCTION 1.8?7 3.953 3.717 3.693 

■ 0.485/ 40. 0.294/ 6. 0.715/ 5. 0.418/6 

]l FEEDBACK - 3.659 3.665 3.676 3.412 



0.573/ 40. 0.501/ 6. 0.730/ 5. C 
Figure B-?. Grouped CC Data 



4,096 


4.269 


0,347/ 7, 


, 0.235/ 5. 


4.108 


4.445 


0.374/ 7, 


o.ni/,5. 


3.574 . 


3,908 


0,503/ 7. 


0.143/ 5. 






0.237/ 7. 


0,363/ 5. 




A MO 


0.433/ 7. 


0J21/ 5. 


J.DlD 


0 IOC 


0.589/ 7. 


0.417/ 5, 


3.7oD 


/I All 

4.011 


0.383/ 7. 


0.137/5. 


3.980 


4.252 


0.559/ 7. 


0.163/ 5. 


3.817 


4.122 


0.425/ 7. 


0.199/ 5. 


3.755 


4.020 


0.386/ 7. 


0.283/ 5. 



SlIMMARy VARIABLE • 


ALL 


DIV A 


DIHB 


Dive 


DIVD 


m E 


11, COUNSELING 


3,686 


3.829 


3,666 


■ 3,554 


3,559 ■ 


. • 4.006 




0,485/ 40, 


0,277/ 6, 


0.660/ 5, 


0,405/ 6. 


0,470/ 7, 


0.133/ 5. 


12, MOTIVATING 


3,615 


3,678 . 


3,584 


3,438 


> 3,611 


3.86 


f 


0,354/ 40. 


0,191/ 6, 


. 0,457/ 5, 


: 0,325/ 6, 


0.350/ 7. 


0.145/ 5. 


,13, REWARD & PUNISfflENT 


3,522. 


3,509 


3.403 


3,427 . 


3.585" 


3.950 




0,552/ 40. 


0,318/ 6, 


0,616/5, . 


0.480/ 6, 


0.539/ 7. 


0.204/ 5.. 



4^ 



NOTE: For reasons of data security, the data shown is not actual, current data; but is from a 
developmental test of the system. 

* ■ « ' 

Figure B-2, Grouped CC Data (Cont'd) 
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NAVTRAEQUIPCEN IH-300 
APPEriDIX C 



EXAMPLES OF TRAINING MATERIALS 



BEFORE WE GO ANY FURTHER 
LET'S TAKE A QUICK REVIEW 
OF JUST WHAT CONCRETE MEANS! 

"CONCRETE" MEANS: 

A) GETTING INVOLVED WITH THE 
RECRUITS. 

B) NOT GIVING THE RECRUITS 
MORE THAN THEY CAN HANDLE. 

C) BEING SPECIFIC AND USING 
DEMONSTRATIONS 

>C 

fPRESS EITHER "A" OR "B" OR "C". THEN PRESS -RETURN-) 



BEING CONCRETE MEANS BEING SPECIFIC AND USING 
DEMONSTRATIONS. AS A COMPANY COMMANDER, IT IS 
VERY IMPORTANT TO BE CONCRETE WHEN DEALING WITH 
YOUR RECRUITS. IF YOU ARE, YOU WILL AVOID BEING 
MISINTERPRETED BY YOUR RECRUITS. 

WHICH OF THE FOLLOWING STATEMENTS IS MORE CONCRETE? 

A) AN EFFECTIVE CC IS B) AN EFFECTIVE CC SETS' 

A GOOD LEADER AND CLEAR GOALS, GIVES ' 

A PRIDE TO HIMSELF DETAILED INSTRUCTIONS, 

AND THE NAVY. AND PROVIDES IMMEDIATE 

FEEDBACK. 

• / ' ' >B' 

, (PRESS "A" OR "B" '..THEN , -RETURN-) 

CORRECT! ' ' f ' • 

THIS STATEMENT IS MORE CONCRE fE' BEMUSE IT DESCRIBES IN DETAIL 
SOME' OF THE. PERFORMANCES OF AN EFFECTIVE CC. , . 

. ^ ' , PRESS -RETURN- 
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NAVTRAEQUIPCEN IH-300 

CONCRETE^ IN GOAL SETTING 

TO SET GOALS CONCRETELY . YOUvNEED TO BE VERY SPECIFIC, 
THIS MEANS BEING DETAILED. TELL THE T. U. EXACTLY WHAT 
IT IS YOU EXPECT THEM TO DO. \ 

. THE FOLLOWING STATEMENT MADE BY A\CC IS AN EXAMPLE OF GOAL 
SETTING. \ 

IS THIS STATEMENT CONCRETE IN TERMs\f BEING SPECIFIC? 

(PRESS "Y" OR "N" AND PRESS -RETURN^)\ 

>N ...ROGERS, As A STARBOARD LEADING P;0., YOU SHOULD SET A 
BETTER EXAMPLE FOR THE MEN. 

OF COURSE! THE CG DOES NOT DESCRIBE IN DETAIL WHAT A BETTER 
EXAMPLE IS. 



PRESS -RETURfi- 



CONCRETE IN GOAL SETTING 

'TO SET GOALS CONCRETELY, YOU NEED TO BE VERY SPECIFIC. 
THIS MEANS BEING DETAILED. TaL THE T. U. EXACTLY WHAT 
IT IS YOU EXPECT THEM TO DO. 

THE FOLLOWING STATEMENT MADE BY A CC IS AN EXAMPLE OF GOAL 
SETTING. 

IS THIS STATEMENT CONCRETE IN TERMS OF BEING SPECIFIC?' 

(PRESS "Y" OR "N" AND PRESS -RETURN-) 

> Y ...I EXPECT TO SEE OUR 3.2 IN BARRACKS IMPROVED 
NEXT WEEK! 

EXACTLY! THE CG HAS DESCRIBED IN DETAIL HOW THE TRAINING t 
UNIT SHOULD DO ON THEIR BARRACKS INSPECTION. ' 

PRESS -RETURN'- 
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NAVTRAEQUIPCEN IH-300 



CONCRETE IN GOAL SETTING 



TO SET GOALS CONCRETELY, YOU NEED TO BE VERY SPECIFIC. 
THIS MEANS BEING DETAILED. TELL THE T. U.- EXACTLY WHAT 
IT IS YOU EXPECT THEM TO DO. 

THE FOLLOWING STATEMENT MADE BY A CC IS AN EXAMPLE OF GOAL 
SETTING. 

IS THIS STATEMENT CONCRETE IN TERMS OF BEING SPECIFIC? 
(PRESS "Y" OR "N" AND PRESS -RETURN-) 
>Y ...JOHNSON, TRY TO BRING YOUR ACADEMICS SCORE UP TO THE T.U. 



TO SET GOALS CONCRETELY, YOU NEED TO BE VERY SPECIFIC. 
THIS MEANS BEING DETAILED. TELL THE T.U. EXACTLY WHAT 
IT IS YOU EXPECT THEM TO DO. 

I 

THE FOLLOWING STATEMENT MADE BY A CC IS AN EXAMPLE OF GOAL 
SETTING. 

IS THIS STATEMENT CONCRETE IN TERMS OF BEING SPECIFIC? 



> N ...I WANT TO SEE SOME MORE TEAMWORK AROUND HERE! 
CORRECT! 

THE CC DOES NOT EXPLAIN IN DETAIL WHAT TEAMWORK MEANS. 



AVERAGE THIS WEEK. 



CORRECT' 

JOHNSON KNOWS EXACTLY WHAT THE CC WANTS. 



PRESS -RETURN- 



CONCRETE IN GOAL SETTING 




OR "N" AND PRESS -RETURN-) 



PRESS -RETURN- 
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NAVTRAEQUIPCEN IH-300 

CONCRETE IN GOAL SETTING 

TO SET GOALS CONCRETELY, YOU NEED TO BE VERY SPECIFIC. 
THIS MEANS BEING DETAILED. TELL THE T. U. EXACTLY WHAT 
IT IS YOU EXPECT THEM TO DO. 

THE FOLLOWING STATEMENT MADE BY A CC IS AN EXAMPLE OF GOAL 
SETTING. 

IS THIS STATEMENT CONCRETE IN TERMS OF BEING SPECIFIC? 

(PRESS "Y" OR "N" AND PRESS -RETURK-) 

>N ...THERE SHOULD BE NO HITS FOR GEAR ADRIFT AT BARRACKS 
INSPECTION TOMORROW. 

INCORRECT!!! 

BY SPECIFYING GEAR ADRIFT, THE CC is POINTING OUT A SPECIFIC 
OBJECT IN THE INSPECTION. 

PRESS -RETURN- 



CONGRATULATIONS! YOUR SCORE WAS 
5 ■ 

OUT OF 6 CORRECT. LET'S CONTINUE LEARNING ABOUT CONCRETE. 

PRESS -RETDRN- 
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